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The traditional way of studying temporal networks is to aggregate the dynamics of the edges to 
create a static weighted network. This implicitly assumes that the edges are governed by Poisson 
processes, which is not typically the case in empirical temporal networks. Consequently, we examine 
the effects of non-Poisson inter-event statistics on the dynamics of edges, and we apply the concept of 
a generalized master equation to the study of continuous-time random walks on networks. We show 
that the equation reduces to the standard rate equations when the underlying process is Poisson and 
that the stationary solution is determined by an effective transition matrix whose leading eigenvector 
is easy to calculate. We discuss the implications of our work for dynamical processes on temporal 
networks and for the construction of network diagnostics that take into account their nontrivial 
stochastic nature. 
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I. INTRODUCTION 



Over the past two decades, myriad papers have illus- 
trated that understanding of complex systems composed 
of large numbers of interacting entities can be improved 
considerably by adopting a network-science perspective 
In particular, the influence of network architecture 
on dynamical processes such as random walks, biologi- 
cal and social epidemics, and opinion formation is now 
well-appreciated (and somewhat better understood than 
it used to be) 0. The effects of network structure on 
dynamics on networks have been investigated using a va- 
riety of techniques, including mean- field theories and pair 
approximations, spectral methods, and numerical simu- 
lations 

In the study of dynamics on networks, there has been 
intense focus on network structure — i.e., the arrangement 
of edges and their associated weights — but the effects of 
the temporal patterns of edges remains very poorly un- 
derstood Q. In a realistic setting, many networks are 
not static, as both edges and nodes can appear and dis- 
appear, and this has a strong effect on spreading pro- 
cesses j5l-[l2|. Most studies of networks tend to overlook 
such temporal patterns by assuming a time-independent 
set of nodes and assigning a single scalar to represent a 
weighted edge Aij between each pair of nodes i and j. 
This scalar is supposed to represent some sort of aggre- 



gate importance of the connection between i and j, and 
it is often understood as a rate in the case of continuous- 
time processes [l^. From such a Poisson perspective, 
the probability that an edge appears between two nodes 
i and j in a time interval of length dt is given by dt/ [rij), 



where {rij) = 1/Aij (where 



~oo if i and j are 
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not connected by an edge) is the mean inter-event time 
and the time r between two consecutive events obeys an 
exponential distribution with mean (r). 

This Poisson assumption facilitates theoretical analy- 
sis, provides intuitive results, and is reasonably accurate 
for a variety of physical and biological systems in which 
the rate at which events take place does not depend on 
their histories. However, numerous socio-economic sys- 
tems exhibit non-Poisson temporal statistics due to their 
non-stationarity or their non-Markovian nature. Obser- 
vations made in financial markets , email (TBI - flsj , let- 
ter (Toj or online 20l. 21 1 communication networks, and 
face-to-face contacts [221 , have shown that the time inter- 
vals between isolated actions performed by an individual 
or between isolated interactions for a pair of individuals 
deviates significantly from a Poisson process. This be- 
havior has important implications, e.g. for the spreading 
of epidemics |23j . 

Two perspectives have been used to attempt to go be- 
yond the unrealistic Poisson assumption. First, one can 
perform simulations on temporal graphs for which a time 
series of the presence versus absence of edges is deduced 
directly from empirical observations [lo| . However, 
such a computational approach has a significant draw- 
back: It relies entirely on simulations and/or algorithms 
to produce, e.g., time-randomized versions of the original 
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data, and it is thus unable to improve underlying theo- 
retical understanding or build predictive models of the 
problem. Second, one can study the problem in a more 
abstract manner by developing spreading models that in- 
corporate realistic temporal statistics. Such models can 
then be studied either mathematically or using numerical 
simulations [ill, [3 ■ In this second approach, the under- 
lying network is seen as a fluctuating entity. One typi- 
cally assumes that it is driven by a stationary stochastic 
process, which allows exhaustive computational experi- 
mentation through the analysis of ensembles of realiza- 
tions and by tuning structural and temporal parameters. 
This modeling perspective also lends itself to mathemat- 
ical analysis [Ij, l25[ , though most research on it thus far 
has been computational in nature. 

In this paper, we take the second approach and argue 
for the development of a mathematical framework to ex- 
plore the effect of non-Poisson inter-evcnt statistics on 
dynamics. To do so, wc apply the concept of a general- 
ized master equation [2^, which is traditionally defined 
on networks with regular structures (i.e., on regular lat- 
tices), to the study of continuous-time random walks on 
networks. Generalized master equations lie at the heart 
of the theory for anomalous diffusion and have applica- 
tions ranging from ecology p8| to transport in materials 
p?! . Our choice regarding what dynamics to consider is 
motivated by the importance of random walks as a way to 
understand how network structure affects dynamics and 
to uncover prominent structural features from networks. 

The rest of this paper is organized as follows. We first 
introduce the process and derive its generalized master 
equation in both ordinary space and Laplace space. After 
checking that the equation reduces to standard rate equa- 
tions when the underlying process is Poisson, we focus on 
its stationary solution and show that it is determined by 
an effective transition matrix whose leading eigenvector 
can be calculated rapidly even in very large networks. 
Finally, we discuss the implications of our work in terms 
of dynamical processes on time-dependent networks and 
for the construction of network diagnostics that take into 
account their nontrivial stochastic nature. 



II. GENERALIZED MASTER EQUATION 

In this section, we derive a generalized master equa- 
tion for continuous-time random walks with arbitrary 
waiting-time statistics. 

A. Beyond Static Weights on Edges 

Consider the iV-node directed graph Q in Fig. [T] To 
avoid unnecessary complications, we assume for this dis- 
cussion that Q is strongly connected (which means that 
one can reach any node starting from any other node). 
A network is typically represented using an adjacency 
matrix A whose elements Ai^ indicate the connection 



strength between each pair of nodes i and j. For an 
unweighted network, Aij can take either the value 1 (if 
there is an edge) or the value (if there is not one). 
For a weighted network, Aij can take an arbitrary value 
(which is also non- negative in most studies) , and a value 
of again indicates the absence of an edge. 

Whether one is considering a weighted or an un- 
weighted network, one typically aggregates networks 
evolving over a certain time interval and thus ignores 
the temporal pattern of edges, which can be of critical 
importance in empirical situations We propose in- 
stead to assign to each edge an inter-event time distribu- 
tion that determines when a edge is accessible for trans- 
port. The dynamics of a network are thus characterized 
by slu N X N matrix ip (t) of smooth, piecewise continu- 
ous waiting-time distributions (WTDs) (t) that deter- 
mine the appearances of an edge emanating from node j 
and arriving at node i. We further assume that the edges 
remain present for infinitesimally small times, which im- 
plies that the network is empty (and thus that the entries 
of the adjacency matrix are 0), except at random instan- 
taneous times determined by ijj (t) , when a single edge is 
present. From now on, we use the following terminology: 
Q is called the underlying graph — i.e., this graph deter- 
mines which edges are allowed and which are not; and 
ipij (t) determines a dynamical graph, in which edges ap- 
pear randomly according to the assigned waiting times. 
We use this random process to model the transitions of 
a random walker moving on the graph. By construction, 
a walker located at a node j remains on it until an edge 
leaving j toward some node i appears. When such an 
event occurs, the walker jumps to i and waits until an 
edge leaving i appears. 

There are several ways that one can set up the WTDs 
Ipij (t). We consider the case in which a WTD corre- 
sponds to the probability for an edge to occur between 
time t and t + dt after the random walker arrives on node 
j in the previous jump. In other words, all edges leaving 
j have their clocks reinitialized when a walker arrives on 
it [43|. It follows from the definition that 

Jq 

The probability that an edge appears between j and i 
before time t is 

JO 

and the probability that it does not appear before time 
t is therefore 

X^3 (i) = 1 - / it') dt' . 

Jo 

If a transition from j to i is not allowed, then the corre- 
sponding clement ipij{t) is equal to for all times. Ad- 
ditionally, we assume for simplicity that the underlying 
network Q has no self-loops. 
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FIG. 1: A directed graph with A'' = 3 nodes and no self- 
loops. The waiting-time distribution -ipij (t) characterizes the 
appearances of an edge from j to i. 

It is important to distinguish between the WTD tpij (t) 
of the process that might lead to a step and the proba- 
bility distribution Ty (t) for actually making a step to i. 
This distinction is necessary because all of the processes 
on a node are assumed to be independent of one another, 
but the probability to make a step depends on all of the 
processes. As an illustration, consider a walker on a node 
j with only one outgoing edge to i. The probability dis- 
tribution function (PDF) to make a step to z a time t 
after having arrived on j is then 

However, if there exists another edge leaving j (e.g., an 
edge to node k), then the PDF to make a transition to 
i is modified, as a step to i only occurs if the edge to i 
appears before the one going to fc. In this situation, 

T^J (t) = Vij (t) Xkj (t) ■ 

In general, the PDF to make a step from j to i ac- 
counting for all other processes on j is 

=V'y w xn(^i-^Vfe,(Orfi') • (1) 

Equation ([T]) emphasizes the importance of the temporal 
ordering of the edges in the diffusive process. It can also 
be written as 

T.,W = -%^xnx;..W, (2) 
"■^ k^i 

as x'ij{t) — ^V'ij (^)- extreme scenario occurs when 
ipij = 5{t — tij) and V'fcj = ^(i — t^j) for Uj > tkj- In this 
case, Tij(t) = 0, so a walker located on j never takes the 
edge to i even if this edge appears very frequently as a 
function of time. 



B. Generalized Montroll- Weiss Equation 

We now focus on the trajectories of a random walker 
exploring a temporal, stochastic network. We closely fol- 
low the standard derivation of the Montroll- Weiss (MW) 
equation [26| and generalize it to an arbitrary TV-node 
network of transitions. The probability n,; (t) to find a 
walker on node i at time t is the integral over all probabil- 
ities 5i (t') of having arrived on i at time t' < t, weighted 
by the probability (pi [t — t') of not having left the node 
since then: 

(t) = / 0, - t') {t') dt' . (3) 
JO 

We take the Laplace transform (s) = C{ni{t)} — 
Hi {t) e~^*dt to exploit the fact that the convolution 
reduces to a product in Laplace space [s^ : 

fli (s) = $i (s) Qi (s) . (4) 

We obtain the quantity (pi (s) from the PDF as follows. 
Making a step from node i to any other node gives 

N 

Tdt)^J2^,, {t) . (5) 
i=i 

(Note that Ta = because there are no self-loops.) The 
PDF to remain imixiobile on i for a time t is thus 

= f T, {t') dt' . (6) 

Jo 

Taking the Laplace transform of equation (|6]) then yields 

^^ {S) = l{^-T^ («)) • (7) 

The quantity Qi (s) is the Laplace transform of the PDF 
Qi (t) to arrive on node i exactly at time t. One calculates 
it by accounting for all fc-step processes that can lead to 
such an event [3J]: 

oo 
k=0 

where qf'^ (t) represents the probability to arrive on node 
i at time t in exactly k steps. Note that the PDF at i is 
related to that at j by the recursion relation 

9f it) ^ f drY^ T,, {t - r) (r) . (8) 
Jo ^ 

In other words, the probability to arrive on node i in fc+1 
steps is the probability to arrive on any other node j in k 
steps weighted by the probability of making a step j ^ i 
at the required time. 
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Upon taking a Laplace transform, equation 
comes 



bc- 



^(^+1) (,)=^4-(.)^f)(.). 
Summing over all k and adding qf^ (s) yields 

CO CO 

is) + E ^i'^'^ (^) - E (^) E -^f ' (^) + -^.^"^ (^) 



fe=0 



fc=0 



which can also be written in terms of matrices and vec- 
tors: 

g(s) = f (s)g(,s)+q(0) (,s) . 

Noting that q^^^ (t) ^ n{0) S (t), we see that the last term 
is simply n(0), which leads to the following solution in 
Laplace space: 



g(.)= /-r(,s; 



(0) 



(9) 



We insert the expression ([7]) for (j>i (s) and the expres- 
sion ^ for qi (s) into the equation for the walker density 
^ to obtain a generalization of the MW equation [2^] 
that applies to arbitrary network structures: 



Uk (0) 



jk 



i(/-^TW) 'n(O) 



In terms of vectors and matrices, this is written 
n{s) 

where the diagonal matrix Dt is defined as 
(^T)^.(s) = f,(s)%. 



(10) 



(11) 



(12) 



Equation (fTTj) is a formal solution in Laplace space for 
the density of a random walk whose dynamics are gov- 
erned by the WTDs ipij (<). However, taking the inverse 
Laplace transform to obtain the random-walker density 
as a function of time does not in general yield closed form 
solutions. 



C. Integro-differential Master Equation 

The generalized master equation (jlip is an integro- 
differential equation that describes the evolution of the 
system in the time domain. In principle, it can be solved 
numerically to obtain the random-walker density as a 
function of time. To do this, we need to use the property 



C [^] = sfi (s) — n (0) of the Laplace transform, which 
holds provided that the Laplace transform of n (t) and 
its derivative exist. As we shall show later, the walker 
density remains properly normalized. 

We define the matrices A = (^I — Dt is)j and B = 

(^I — T (s)j . We then insert n (s) from the generalized 
MontroU- Weiss equation ([Tl]) to obtain 



C 



dn 
Itt 



sfi (s) — n (0) 



1 



= {AB-^ - I) {sBA-^) \y-AB-^n (0) 
= {A - B)sA-^h{s) . 

Using the definitions for A and B and simplifying yields 



C 



dn 



T{s)-DTi.s) 



Dt{s) 



n{s) 



n (s) 

I~Dt{s) 

^(f{s)D^^{s)-l)Kis)nis), (13) 

where we have defined the Laplace transform of the mem- 
ory kernel K as 



k{s) 



sDt js) 
I-Dt (s) 



(14) 



The memory kernel characterizes the amount of mem- 
ory in the dynamics j29j . The memory kernel K{t) is 
usually a function spanning over a non-vanishing time 
period. A notable exception is a Poisson process, for 
which K{t) = S{t). The entries of Dt {s) are strictly 
smaller than unity for all finite s because Tj (s) ~ 
joo g-sty^. < jj» j,^ dt = 1 (as we shall show 

in Section FlI Ep . Hence, the term / — Dt (s) is always 
invcrtible. 

Taking the inverse Laplace transform of leads to 
the generalized master equation 

^ = (r (t) * {d^' (s)} 6 (t)) *K{t)*n it) , 

(15) 

where C ^ denotes the inverse Laplace transform and 
f * g = /g drf {t — t) g (t) denotes convolution with re- 
spect to time. Unfortunately, mathematical analysis of 
(|T5]) is difficult. However, as we will exploit later, it is of- 
ten significantly easier to analyze its Laplace-space equiv- 
alent pT|) . 

Note that Dt (s) can in principle be singular but con- 
sidering Dj^^{s)K{s) ~ - — / , . as one term resolves 
this problem. 



I-Dt{s) 
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D. Conservation of Probability 

The total number of random walkers is a conserved 
quantity, so ^ rij {t) — 0. It is not easy to verify this 
directly in the time domain using ([TS|) . Thankfully, it 
is sufficient to show that the Laplace transform of the 
rate of change of the number of walkers vanishes be- 
cause {0} — 0. The inverse Laplace transform is 
unique except for null functions which are defined by 

JV (t) dt = for all a > 0. By assuming that the 
WTDs are piecewise continuous we exclude null func- 
tions and the inverse Laplace transform is guaranteed to 
be unique [13, HH . 

Equation ([T51) gives the rate of change of the total 
walker density in Laplace space: 



ikj ^ 



kj 

6ik Skj 



K{s)n{s) 
- SikSkj 



E 



Tk{s) 



Y.^^k is) 



- 1 



K{s)fi{s) 
K{s)n{s) 

k (s) fi (s) 



0, 



which confirms that the rate of change of the total walker 
density vanishes. 



E. Making Steps in Infinite Time 

In this paper, we have assumed that the underlying 
graph Q of potential edges is strongly connected, which 
implies that a transition from j to some other node is 
guaranteed to occur eventually if one allows infinite time. 
We thus expect that Tj (<) 1, as T.j (t) is the PDF 
to make any transition from j . We use equations ^ and 
(ISl) to obtain 



i=l 



1=1 



dt 



n 



Integrating over the entire time domain yields 
1'°° f°° d / ^ \ 



because Xij (0) = 1 and Xij (oo) = when the edge j ^ i 
exists in the underlying graph, whereas Xij (0) = 1 and 
Xij (oo) = 1 otherwise. 



F. Poisson Limit 

Assume that edge dynamics are Poisson processes and 
that the WTDs are exponential distributions [s^ with a 
characteristic rate for the transition j i: 



(t) = A„-e-^-^* . 
Equations ([1]) and (O then imply that 



J|e-^'^* = A 



ije-^'^^'dt' 



(16) 

(17) 
(18) 



and 



where the aggregate transition rate from j is defined as 
Aj = X]t=i ^ij- "T^^ Laplace transform of Tj (t) becomes 

A, 



T, is) = 



A, + s 



Equation (|12p then becomes 
^t(s) 
which in turn yields 



A, 



Equation ((Ti)) becomes 



k,, is) 



Aj+s 



-Sii = 



sAw 



(19) 



AT-^ - A , ,^A., % = A.^.- . (20) 



Taking the inverse Laplace transform of ([T5|) yields 



£-1 



A^-'(^) + (21) 



and taking the inverse Laplace transform of ^U\\ gives 

K,,{t)=A,S{t)S.,,. (22) 

We insert equations ([17]), and 1^ into the gen- 

eralized master equation (jlSp and use the properties of 
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the Kronecker delta 6ij and Dirac delta function 6{t) to 
obtain 



(23) 



Note that 

e-^-**[A^(5(i)+5' (t)] 

where the integration of the convolution with d' (t) is per- 
formed using integration by parts. Inserting this result 
into equation p3p yields the rate equation [39| 



dn 



(24) 



driven by the combinatorial Laplacian = Xij —AiSij of 
a weighted network defined by the adjacency matrix Xij. 
This expression thus shows that a random walk on the 
dynamical graph driven by (|16p is equivalent to a Poisson 
continuous-time random walk on a static network, which 
is constructed in the usual manner by counting the num- 
ber of times edges appear between each pair of nodes. In 
other words, the rate is equal to the number of observed 
appearances of an edge divided by the duration of the 
observation. 



III. ASYMPTOTIC BEHAVIOR 

A. Steady-State Solutions 

We expect the walker distribution to settle into a 
unique steady-state solution as i -^■ oo if any node can 
be reached from any other node. By the so-called final 
value theorem [s^] , the steady-state walker density p is 

p = lim n (t) ~ lim s-h (s) . 

■f— >oo ss-0 

The final value theorem requires that h (s) does not have 
poles in the right half of the complex s-plane or on the 
imginary axis (except possibly at the origin). As we shall 
show later, s-h (s) has a pole at s = 0, and only this pole 
contributes to the steady-state solution [32j . 
From equation pT|) . one obtains 



p = lim [I - Dt {s)] [I - T (s) 
= Mn (0) , 



(0) 



where the matrix 



lim [I -D is)) [I-T{s] 



maps the initial state to the final state. In the limit 
s -H- 0, one can expand the exponential in the definition 
of the Laplace transform to first order: 



Dt{s) = / [1- st + 0{s^)]T^it)S,jdt 
-I V Jo 

= [1 - ,s(t,) + O {s^)] 5.,, 
- / - sDf^t^ + O (s2) , 

where {tj) = tTj (t) dt is the mean time spent on node 



j and we have defined the diagonal matrix D^^^ 
One can also use the approximation 

f,j = / [\- st + 0{s')]T,j{t)dt 
Jo 



T,: 



-dt + 0{s^ 



(25) 



where (tij) is the mean time before making a step j ^ i. 



T,j{t)dt 



is the probability of making a step j ^ i and is a measure 
of the relative importance of the edge. T is called the 
effective transition matrix. One can write ()25p in matrix 
form as 

f = T-sTo{t)+0 (s^) , 

where o denotes the Hadamard component- wise product. 
The operator M becomes 



lim 



sZ?(t> (/-T-sTo(t))- 



and it is expected to project any initial condition onto 
a unique one-dimensional vector if the underlying graph 
Q consists of one strongly connected component. The 
steady-state solution is thus given by the leading eigen- 
vector (i.e., the eigenvector corresponding to the maxi- 
mum eigenvalue) of the projection operator M. In prac- 
tice, it is easier to obtain the least dominant eigenvector 
(i.e., the eigenvector whose corresponding eigenvalue is 
the smallest in absolute value) of the inverse of the pro- 
jection operator 



hm - \I 

s^Q s 



T 



1-1 

t) 



= lim 



sTo{t)]D^, 
-{I-T)Dl^^-iTo{t))Dl^^ 



In the limit s — !> 0, the eigenvectors of M tend to the 
eigenvectors of the matrix C = (/ — T) D^^^ because the 
second term in the above equation becomes negligible in 
comparison to the first. Thus, finding the least dominant 
eigenvector of C is equivalent to finding the dominant 
eigenvector of M in the limit s 0. Note that D(^t) is 
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invertible unless the mean time spent on any node {tj) is 
zero. This would imply that any walker that arrives at 
j immediately makes a step to another node i such that 
the labels i and j actually refer to the same node. D^^^ 
is thus always invertible in practice. 

The matrix T is a stochastic matrix because its 
columns are normalized (as we have shown in Section 
IIIEp . In particular, T has a single eigenvector, which we 
denote by x, whose eigenvalue is equal to unity if Q is 
strongly connected [33| — i.e., Ta; = x. This implies that 
the steady-state walker density p is given by 

p = Z?(t)X (26) 

as it is the least dominant eigenvector of C: 

Cp={I-T)D-]D(^t)X 
= Ix - T.T = . 




UN {Q = 1/2 

FIG. 2: An undirected network with N — 3 nodes and no 
self-loops. The waiting time distributions used for the edges 
a, b, and c are exponential, a-nd Rayleigh, with means 
(ta), (tb) and (tc) respectively. 



Given the complexity of the stochastic process and the 
integro-differential nature of its associated master equa- 
tion, it is remarkable that one can write down such an 
exact analytical expression. This equilibrium solution 
takes a particularly simple form, as it is calculated from 
the dominant eigenvector of the combinatorial Laplacian 
associated with the effective transition matrix T. The 
time spent on node i is thus given by the frequency to 
arrive on it (which is obtained by the Markov chain as- 
sociated to T) multiplied by the waiting time (ti) spent 
on it. This solution can be computed easily even for very 
large graphs, as deriving T from ijj is straightforward and 
the leading eigenvector of a large matrix can be obtained 
through standard, efficient techniques (e.g., the power 
method) 

It remains to be shown that sn (s) has a pole at s = 
0, which would guarantee that the requirements of the 
final value theorem are satisfied. From equation it 
follows that h (s) has poles whenever I — T{s) is singular. 
Using (|25p . we find in the limit s — > that 

(^/ - f{s)j X = {I -T - sTo {t))x + O (s^) 

= Ix - Tx - sT o {t)x + O (s^) 
= -sTo{t)x + 0{s^) . 

Hence, x is an eigenvector of / — T{s) with eigenvalue 
0. Because dot — T{s)j is equal to the product of 
eigenvalues, / — T{s) becomes singular as s — > 0. 

B. Poisson Versus Non-Poisson Processes 

We now discuss some of the differences arising from 
the non-Poisson nature of the process versus the Poisson 
situation that is usually considered. For simplicity, we 
illustrate these differences using an undirected network, 
for which ipij = tjjji. 



For the Poisson process ([T6|) . it is straightforward to 
show from equation p7p that the effective transition ma- 
trix T satisfies 



2^1=1 

where Xij is the adjacency matrix of an undirected and 
static weighted network, where the weights are the rates 
at which edges appear in the dynamical network. The 
stationary solution is a uniform vector, which is expected, 
as it is the dominant eigenvector of the Laplacian matrix 
in (p4l). 

The case of a non-Poisson process differs significantly 
from this idealized scenario in at least three ways. First, 
T is no longer in general the transition matrix of an undi- 
rected network, even in the symmetric case ipij = ipji that 
we consider. Evaluating the stationary solution thus re- 
quires one to calculate the dominant eigenvector x of T. 
Second, there is no reason to expect that the station- 
ary solution p is uniform; indeed, it is not uniform in 
general. Finally, p is a stationary solution only in the 
limit t -> oo and not also for intermediate times, as we 
used an expansion for small s throughout section UlI Al to 
derive its expression. This behavior originates from the 
time-dependent nature of the stochastic process, as one 
can see because of the integral over time in the general- 
ized master equation (jlSp . This has interesting implica- 
tions. For example, a process starting with the station- 
ary solution p as an initial condition exhibits transient 
deviations to stationarity before returning to its initial 
condition as t — >■ oo. In contrast, if the dynamics on 
the graph are Poisson, then the steady-state solution is 
time- independent. In other words, once the system has 
reached its steady-state solution, it will stay there. 

To illustrate how the nature of the WTDs affects dy- 
namics, consider the toy example of a fully-connected 
graph with three nodes. Suppose that the WTDs for the 
processes occurring on the nodes have different functional 
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FIG. 3: Random-walker density on each node as a function 
of time obtained from numerical simulations for the Poisson 
(upper panel) and non-Poisson (lower panel) processes. In 
the former case, we also plot the analytical solution of the 
rate equation. The error bars give a confidence interval of 
5 standard deviations. For the non-Poisson example, we ob- 
tained the steady-state walker density from equation (|26|) .The 
relaxation towards stationarity exhibits kinks in the dynam- 
ics that originate from the non-continuity of the waiting-time 
distributions. 



types and different characteristic times (see Fig. [2]). We 
compare this non-Poisson case to a Poisson process witli 
the same average rates . The associated matrix, wliicli 
corresponds to the adjacency matrix of (P71) . is 




We illustrate the differences between the two processes 
in Fig. 131 where we perform numerical simulations of the 
random walk (see the Appendix for computational de- 
tails) with all walkers located at node 1 initially, and 
we plot the temporal evolution of the walker density. 
The system relaxes towards a stationary solution in both 
cases, but this stationary solution clearly depends on the 
nature of the WTDs, as walkers tend to be overrepre- 
sented on node 1 for the non-Poisson dynamics. Figure|4] 
clearly conveys the importance of the time-dependence 
of the process and the fact that its steady-state solution 
is truly steady only at long times. 
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FIG. 4: Random-walker density on each node of the graph 
illustrated in Fig.[2]as a function of time when the initial con- 
dition is the steady-state solution. Due to the time-dependent 
nature of the dynamics, the system exhibits transient dynam- 
ics before returning to its steady-state solution. The error 
bars again give a confidence interval of 5 standard deviations. 



IV. DISCUSSION 

The overwhelming majority of research that considers 
dynamics on networks implicitly includes a Poisson as- 
sumption. For instance, this is the case when one builds 
an aggregated network from empirical data and assigns 
only a single number (i.e., a weight) to edges to sum- 
marize their dynamics. In that framework, edge weight 
is understood as a rate of interaction between nodes, so 
such a choice would imply that events occur in an uncor- 
rclated fashion. The main purpose of the present work is 
to consider a mathematical framework that goes beyond 
this oversimplification and thereby propose a compromise 
between abstract but unrealistic models and data-driven 
but non-mathematical approaches for studying tempo- 
ral networks. In the proposed framework, temporal net- 
works are viewed as sequences of realizations of random 
networks in which present events depend on past ones. 
The temporal and structural organization of a system 
is summarized by a matrix of waiting time distributions 
(WTDs) that characterize the pattern of activation of 
edges between nodes. In this paper, we have derived 
a generalized master equation for a random walk asso- 
ciated with this process, obtained an expression for its 
stationary solution, and used a toy network to highlight 
the importance of the shape of WTDs. 

The present paper is a step towards a mathematical 
description of temporal networks, and it suggests several 
research directions. An important step will be thorough 
consideration of empirical data, such as human communi- 
cation patterns, to help design appropriate WTDs and to 
study how their shape affects equilibrium solutions. This 
step is related to the development of network diagnostics 
that properly take into account the temporal dynamics of 
complex systems [ssl - fssj , whose behavior arises not only 
from their structural patterns but also from their dynam- 
ics. The investigation of complex systems thus requires 
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the development of diagnostics that consider both struc- 
ture and dynamics (39j . The fact that most existing net- 
work diagnostics account only for the presence, weight, 
and direction of edges and assume that they are present 
for all time presupposes an underlying Poisson process, 
which can yield a fundamentally incorrect representation 
of a system. Indeed, assuming a Poisson waiting time can 
be as unrealistic as assuming that the topology of a net- 
work is organized like an Erdos-Rcnyi random graph. It 
is thus crucial to develop network concepts that account 
for nontrivial temporal dynamics. This includes central- 
ity measures (like Pagerank [4^ ) , which measure the im- 
portance of network components in various ways, and the 
components of the steady-state solution vector derived 
in this paper provide an example of one such diagnostic. 
Another example is community-detection methods based 
on the idea that non-Poisson random walkers are trapped 
for long times in good communities [4l|, |42|, though of 
course there is much more that one can do. Other in- 
teresting research directions include the development of 
a sound mathematical framework for various dynamical 
processes, such as synchronization or epidemic spreading 
[25| and the study of random walks with alternative ways 
to build the matrix of waiting times. For example, the 
dynamics could be driven by the normalized Laplacian 
in the Poisson limit. 
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Appendix A: Numerical Simulation 

We implemented the numerical simulation in C# us- 
ing the Math . NET library to simplify the generation of 
random numbers from various distributions. 

The approach in this paper requires computing the 
probability of finding a walker on a certain node. To 
approximate this numerically, we simulate 10^ random 
walks for each scenario and average over the realizations 
of the walk in order to estimate the walker density nu- 
merically. 



1. Generating Trajectories 

The trajectory of a walker is generated by making con- 
secutive steps until the maximum simulation time tmax 
is reached. See Algorithm [TJ 



Algorithm 1 Generation of the trajectory of a random 

walker. 

1: history := new History() {Create a store to keep track of 
steps.} 

2: history.CurrentNode ~ input (startNode) {Get the ini- 
tial node.} 
3: while (history. Time< tmax) do 

4: currentEdges := from edge in t/-Edges where 
edge.Sourcelndex — history.CurrentNode. Index) select 
edge {Select a list of edges over which a walker can leave 
the current node.} 

5: step := new Step() {Create a new record.} 

6: step. Delta ~ oo {Declare a minimum wait.} 

7: for each edge in currentEdges do 

8: sample :— edge. Distribution. GetSample() {Obtain a sam- 
ple from the WTD of the edge.} 
9: if (sample < step. Delta) {Does the step along this edge 

occur before all previous edges?} then 
10: step. Delta := sample {Assign the new minimum wait.} 
11: step. Edge :— edge {Store the associated edge.} 
12: end if 
13: end for 

14: history.Add(step) {Add the step to the history.} 
15: end while 



2. Averaging Over Different Realizations 

Steps in each of the 10^ different realizations are made 
at irregular intervals. We consider a set of k finite in- 
tervals of width At = 0.01 such that kAt = tmax- The 
probability to find a random walker on node j during a 
certain interval is then given by the mean over all real- 
izations of the fraction of the time spent on j during this 
interval. Consider a single realization of a random walk 
on a graph of three nodes (see Fig. In Table HI we list 
the fractions of time spent on each of the nodes in the 
contribution to the average. 
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